The Perils of Randomization Checks in the Analysis of Experiments

نویسندگان

  • Diana Mutz
  • Robin Pemantle
چکیده

In the analysis of experimental data, randomization checks, also known as balance tests, are used to indicate whether a randomization has produced balance on various characteristics across experimental conditions. Randomization checks are popular in many fields although their merits have yet to be established. The grounds on which balance tests are generally justified include either 1) the credibility of experimental findings, and/or 2) the efficiency of the statistical model. We show that balance tests cannot improve either credibility or efficiency. The most common “remedy” resulting from a failed balance test is the inclusion as a covariate of a variable failing the test; this practice cannot improve the choice of statistical model. Other commonly suggested responses to failed balance tests such as post-stratification or re-randomization also fail to improve on methods that do not require balance tests. We advocate resisting reviewer requests for randomization checks in all but some narrowly defined circumstances.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

he Impacts of Bounced Checks on Economic Growth Through the Banking Credit Risk Channel Emphasis on Enforcement of Laws: Provincial Panel Approach

This study investigates the relation between bounced checks and economic growth through the banking credit risk channel by estimation of a simultaneous equation system with panel data for 31 Iranian provinces covers the years from 2011 to 2015. For this purpose, after identifying determinants of the bounced checks, the relations of this variable with the non-performing loans, banking loans and ...

متن کامل

Enabling Compassionate Health Care: Perils, Prospects and Perspectives

There is an emerging consensus that caring and compassion are under threat in the frenetic environment of modern healthcare. Enabling and sustaining compassionate care requires not only a focus on the needs of the patient, but also on those of the care giver. As such, threats and exhortations to health professionals are likely to have limited and perverse effects and it is to the organisational...

متن کامل

Toward More Compassionate Healthcare Systems; Comment on “Enabling Compassionate Healthcare: Perils, Prospects and Perspectives”

Compassion is central to the purpose of medicine and the care of patients and their families. Compassionate healthcare begins with compassionate people, but cannot be consistently provided without systemic changes that enable clinicians and staff to collaborate and to care. We propose seven essential commitments to foster more compassionate healthcare organizations and systems: a commitment to ...

متن کامل

On the Perils of Universal and Product-Led Thinking; Comment on “How Neoliberalism Is Shaping the Supply of Unhealthy Commodities and What This Means for NCD Prevention”

Lencucha and Thow’s paper offers an important addition and corrective to the burgeoning body of work in public health on the ‘commercial determinants of health’ in the context of non-communicable diseases (NCDs). Rather than tracing the origins of incoherence across policy sectors to the nefarious actions of industry, they argue that we need to be better attuned to the ...

متن کامل

Quality of Randomization in Clinical Trials Published in Persian Journals of Medical Sciences Indexed in Scopus during 2013-2017

Background and Objectives: Randomization is one of the principles of correct clinical trial. The aim of this study was to determine the quality of randomization in the published articles of clinical trials in the Persian-language journals indexed in Scopus.  ed in Scopus D Methods: In this cross-sectional study, all clinical trials published in Persian journals indexed in Scopus during 2013-2...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2012